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C . Abstract 

In this paper, we consider the nonconvex minimization problem of the value-at-risk (VaR) 
, that arises from financial risk analysis. By considering this problem as a special linear program 

with linear complementarity constraints (a bilevel linear program to be more precise), we develop 
upper and lower bounds for the minimum VaR and show how the combined bounding procedures 
can be used to compute the latter value to global optimality. A numerical example is provided 
to illustrate the methodology. 
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Dedication. With great pleasure we dedicate this paper to a respected pioneer of our field, 
Professor Olvi L. Mangasarian, on the occasion of his 70th birthday. The two topics of this paper, 
LPECs and smoothing methods, are examples of the vast contributions that Olvi has made in 
optimization, which have benefited us in many ways and which will continue to benefit us in the 
^ ' future. Happy 70th birthday, Olvi! 

m ■ 

O ■ 1 Introduction 

I The value-at-risk (VaR) and conditional value-at-risk (CVaR) are two important risk measures 

' that have been used extensively in recent years in portfolio selection and in risk analysis. Whereas 

■ the VaR is closely related to a particular quantile of a random variable, the CVaR is formally 

"j^ i defined and analyzed by Rockafellar and Uryasev in two papers [HH 0S| as a way to alleviate 

some of the computational difficulties associated with the optimization of the VaR. There is now 
a substantial literature on the applications and further developments of these two risk measures; a 
partial list of this literature relevant to optimization includes the papers []1[T8 l [T9 l [27 | [29 l l3 H l35 l ll0]. 
^ ' In particular, the paper ^\ presents some CVaR-based algorithms for computing the VaR in a 

' portfolio selection problem; in spite of their practical efficiency, however, these algorithms offer no 

guarantee of global optimality of the computed VaR. 

Setting aside some criticisms of the VaR mentioned in the literature, part of which stems from 
the difficulty associated with the portfolio selection problem using the VaR criterion, we study the 
global optimization problem using a scenario formulation, which is the principal approach employed 
in the cited references for solving the (C)VaR minimization problem. Specifically, we consider the 
VaR minimization problem as an LPEC 24,, a linear program with equilibrium constraints, which 
is a subject pioneered by Mangasarian, to whom this paper is dedicated. By exploiting the special 
structure of this program, we derive linear programs whose optimum objective values yield upper 
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and lower bounds for the optimal VaR. The bounding procedures are then used in a branch-and-cut 
algorithm for computing the latter value to global optimality. A numerical example is provided to 
illustrate the algorithm. 

An LPEC is a special case of a mathematical program with equilibrium constraints (MPEC). 
Since the publication of the two monographs '221 UHl! there has been significant computational 
advance in numerical methods for solving MPECs; a partial list of recent references includes [3 
iniII21II31iniIinilIllI3IISll2nilS3IMll3H|- in spite of such extensive efforts, the computation of 
globally optimal solutions to MPECs remains elusive. While some MPEC solvers are fairly robust 
in practice, there is no guarantee that their computed solutions are globally optimal solutions. 
An important reason for this lack of guarantee for global optimality is the fact that these solvers 
are all based on local improvement techniques and no global optimization is incorporated in their 
implementation. As a special MPEC, the VaR minimization problem is amenable to solution by 
any one of the (local) methods. In this paper, we do not stop with this routine adaptation of the 
existing MPEC solvers; instead, our goal is to develop a branch-and-cut algorithm for solving the 
minimum VaR problem to global optimality. 



2 The VaR Minimization Problem 

Let y denote an n-dimensional random vector whose components represent the random losses of 
some financial instruments. Let X C SR" be a closed convex set (polyhedral in many practical 
applications) representing the set of feasible investments. For a given x G SR", z = x^y is therefore 
the random loss associated with the investment vector x. For a given scalar (3 £ (0,1), which 
denotes a confidence threshold of sustainable loss, the CVaR and VaR associated with the random 
variable z is given, as proved in [221133]) by the following two deterministic quantities, respectively: 



CVaRflfx) = min 



YaRf3{x) = min{ m : m £ Ai/3{x)}, 

where lEy denotes the expectation with respect to the random vector y, the subscript plus sign 
denotes the nonnegative part of a scalar (i.e., the plus function t+ = max(0, t)), and A1/3(x) 
denotes the set of minimizers in the definition of CVaR/3(x). By the results in the cited references, 
CVaR/3{x) and VaR/3(x) are well-defined finite scalars for very general loss distributions. Clearly, 
we have 

CVaR/3(x) = VaR/3(x) + TEy{x'^y - YaRf3{x))+ > YaR(s{x), Vx. 

J- fj 

The CVaR and VaR minimization problems are, respectively, 

{minimize CVaR^(x) 1 d < VaR^(x) 1 

subject to x £ X J 1 subject to x £ X J 

Clearly, the CVaR minimization problem can be cast equivalently as the following convex program 
in the joint variable (m, x): 

1 ^ ^ 
minimize m + —TEy[x y — m)^ 

subject to ( m, X ) G X X. 

Nevertheless, the VaR problem is not a convex program; this fact is an acknowledged drawback 
of using the VaR as a criterion in portfolio selection. Our main goal in this paper is to develop 
remedies to this drawback. 
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2.1 An LPEC Formulation 



In the rest of the paper, we take X to be a compact polyhedron. We adopt a scenario approach 
to discretize the random vector y. With this approach, the CVaR minimization problem becomes 
a linear program (LP) and the VaR becomes a bilevel linear program, which we reformulate as 
an LPEC using the optimality conditions of the lower-level LP. Specifically, let {y^,--- ,y^} be 
the finite set of scenario values of y, and let {pi,-" ,Pk} be the associated probabilities of the 
respective scenarios, which, summing to one, are assumed to be all positive. The discretized CVaR 
minimization problem is 

1 

minimize m + pi ( x^^y* — m)+ 

1=1 

subject to ( m, X ) e X X, 
which is equivalent to the linear program in the variables (m, x,r): 



minimize 




(1) 



Vi = 1, . . . ,k. 



For a given x G X, CVaR^(3;) is the minimum objective value of the following simple LP in the 
variable (m,r) G JR^+'^i 



minimize 




(2) 

subject to ^ ^ y i = 1, . . . ,k. 

\ Ti > X y^ — m \ 

By letting Aj denote the dual variable of the ith functional constraint in the above LP can be 
solved trivially via its dual: 



maximize 

i=l 



subject to < Aj < Pi/{1 — /S), \/ i = 1, . . . , k (^3^ 



k 

and >^ A,- 



i=l 



which is a bounded knapsack problem that can in turn be solved by a simple sorting procedure. 
The optimal objective value of either ((2)) or ((21) yields CVaR/3(x); this shows in particular that 
CYaRi3{x) is a convex combination of the portfolio losses {x'^y^, ■ ■ ■ ,x'^y^}. 

In general, by solving either of the LPs (|2j or Q, we are not guaranteed to obtain VaR/3(x) 
right away; to obtain the latter value, we can solve another simple LP in the variable (m,r), with 
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X remaining fixed: 



minimize m 



1 ^ 

subject to m H pi Tj < CVaR(x 



and 



Ti > 

Ti > x^y^ — m 



Vi 



1, . . . ,k, 



which is simply the problem of finding the least element of the argmin ^Afs{x). 
The optimality conditions of ((2)) are 



< Ti ± 



Pi 



Ai > 



1-/3 

< Xi _L Si = m + Ti — x'^y^ > 



l,...,k 



and Aj = 1, 



i=l 

where the _L denotes the well-known complementary slackness condition. Employing these optimal- 
ity conditions, we can reformulate the VaR minimization problem as the following linear program 
with linear complementarity constraints in the variables {m,x,T, X), that is, an LPEC, which in 
turn is a special subclass of the class of mathematical programs with equilibrium constraints |22j : 

minimize m 
subject to X £ X 

< Ti ± - A,- > 



1-/3 

< Xi _L Si = m + Ti — x^y* > 



(4) 



and 



1=1 



1. 



As an LPEC, the feasible region of ((1} is the union of finitely many polyhedra. Exploiting its special 
structure, we state and prove in the result below that (jlj) attains a finite minimum objective value. 

Proposition 2.1 Let X be a compact polyhedron in 3?". The LPEC attains a finite minimum 
objective value. 

Proof. Since X is compact by assumption, one can easily show that m must be bounded below on 
the feasible region of @. In fact, if {rriy^T^ , x^) is a sequence of feasible solutions with my — > — oo, 
then T^ oo for every i. Consequently, X^ = Pi/{1 — (3); but this contradicts the last constraint, 
which requires that the sum of the A's be equal to unity. □ 

Let {niYi^^, x^^^ , T^^^ , X^^^) denote an optimal solution of (@J). Note that whereas mvaR must 
be unique, the triple {x^^^, r^^^^ A^*^^) is not necessarily so. Our goal is to compute /n-vaR as best 
as possible. Although a theoretical guarantee of global optimality is not easy to obtain, we derive 
valid upper and lower bounds for mvaR and develop ways to tighten these bounds; obviously, when 
the upper and bounds coincide, then mvaR is obtained. 
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3 Upper and Lower Bounds 



In this section, we develop valid upper and lower bounds for mvaR- While upper bounds are not 
difficult to compute, sharp lower bounds are less obvious to derive. We formally describe these 
bounds in the next two subsections. Here, we note that if mvaR G [w-lBi ?71ub]i then 



< max 



"^VaR 



rUYaR 



< 



muB - mi^B 
rriLB 



which gives relative accuracies of the upper and lower bound values, muB and mLB, respectively, 
with respect to the exact minimum VaR mvaR- 



3.1 LP Upper Bounds 

In essence, upper bounds for mvaR are obtained by "breaking" the complementary slackness in (jlj) 
(i.e., restricting the feasible region) according to a given feasible solution. Let G X he given. The 
scalar mo = VaR/3(a;'^) provides an upper bound for mvaR- (For instance, we may take x*^ = x^^'^^ 
to be an optimal solution of the CVaR linear program (^.) We wish to improve on the bound ttt-q 
by considering a restriction of the constraints in @. Specifically, associated with the pair (mo, x^), 
let (r°,A°) satisfy 




and 



_L 



Pi 



1-P 



Ay > 



y i = 1, . . . ,k 



< 

k 



A? ± 



= mo + r! 







(x°)^y* > 



i=l 



Define the index sets 



It = 



= <^ f : r" > 



Pi 



< 



Pi 
1-/3 

Pi 



and 







A 

Pi 



{ 



AO > 
A? = 



mo + t\ 







,0 ^fy^ } 



mo + T° - ( x^ } 



{ i : A° = < mo + r° - ( )'^y^ } 
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Let 5^ and 5^ be arbitrary subsets of and /?^, respectively. Consider the following linear program 
in the variables (m, x, r, A): 



minimize m 
subject to X G X 



(5) 



Ti>0 = ^-A„ ViGaOu^o 

Aj > = m + Tj - x^y\ \/i e a^U 6^ 

A, = < m + r,-xV, Vi G 7^ U (/J^ \ 5° ) 

and -^^ ~ 

1=1 

which is obtained by restricting the complementarity constraints in @ based on the above index 
sets. Obviously, @ is equivalent to a simplified LP in the variables (m, r) only, with the A variable 
being removed, that is, 

minimize m 
subject to X £ X 

Ti > 0, G a° U 5° 

ri = 0, Vi G 7° U (/30\<50) 

m + Ti- x'^y' = 0, Vi G U (5^ 

m + r,-xV>0, Vi G 7a U (/JU-^a)- 

It is clear that (mo, x^,t^) is feasible to ©• In general, if (m, x, r) is feasible to ©, then (m, x, r, A'^) 
is feasible to ©, and hence to (jlj). Consequently, © attains a finite global minimum. Moreover, 

if ( m 1 ,x^,r^ I denotes an optimal solution of ©, we must have m 1 G Aij3{x^). Hence, with 

mi = VeiRp{x^), we have 

mo >m I > mi > mvaR- 

One of two cases must occur: (a) mo = mi (no improvement), or (b) mo > mi (strict improvement). 
In case (a), no improvement is obtained with the particular choice of the pair of index sets {5^,5^). 
One can then try a new pair and solve a new LP hoping to obtain a strictly improved bound 
for mvaR- In case (b), we can replace (mo, x*^) by the pair (mi, x^) and repeat the above procedure. 
The following result shows that if strict improvement is obtained at each iteration, then in a finite 
number of steps the exact minimum VaR is found. 

Theorem 3.1 Let {x'^} C X be a sequence of feasible vectors such that for each u, x'^^^ is obtained 
from x'^ by solving a certain restricted LP as described above. If VaR^(x'^) > VaR/3(x'^~''^) for every 
V, then a finite vq exists such that YaR,p{x^'^) = mvaR- 

Proof. The feasible region of Q is the union of finitely many polyhedra, each being the feasible 
set of (jSI corresponding to a particular tuple of index sets (a^, (51^, 7^, a^, 5^, 7^). Since \aKp{x'^) > 
VaR_g(x'^'''^) for every u, the tuples of index sets used to produce the sequence {x'^} cannot repeat. 
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Since there are only finitely many such tuples of index sets, in generating the sequence {x'^} we 
must have encountered all of them; in other words, we must have searched over the entire feasible 
region of (|1J). Consequently, we must have VaR^(x'^°) = myaR for some fQ. □ 

The above result is mainly of theoretical interest because rarely is one so lucky that strict 
improvement can be obtained with each trial choice of (5^,6^). Notice that the procedure described 
herein is based on the premise that the set U /^^ is nonempty, which means that the pair (mo, x") 
is a degenerate feasible solution of (|1J), degenerate with reference to the complementarity conditions. 
When (mo^x^) is nondegenerate, we will not able to continue the procedure. Consequently, this is 
one of the rare instances in mathematical programming where degeneracy actually helps: it enables 
one to continue the search for an improvement in a global optimization procedure. 



3.2 NLP Upper Bounds 

An alternative approach to obtain an upper bound is to form the equivalent nonlinear program 
(NLP) of the LPEC © 

minimize m 
subject to X £ X 



< Ti, 



Pi 



Xi > 



l-P 

< Aj , Si = m + Ti — x^y* > 



y i = 1, . . . ,k 



(7) 



and 



i=l 

k 

E 



i=l 



Pi 



^i + AjSj 



< 0, 



and solve this NLP using standard solvers. The last constraint in this problem is the complemen- 
tarity constraint. Note that we do not require a lower bound on the complementarity constraint in 
(O because all terms in this expression are nonnegative. 

It is well known that the NLP fails the Mangasarian-Fromovitz constraint qualification 
(MFCQ) I23t f?5, at any feasible point. This fact implies that the multiplier set of ((7)) is un- 
bounded, the central path fails to exist, and active constraint normals are linearly dependent. As 
a consequence, solving MPECs as NLPs has been commonly regarded as numerically unsafe. Re- 
cently, however, it has been demonstrated that standard NLP solvers can be employed to solve 
the equivalent NLPs of MPECs reliably and efficiently. The convergence of sequential quadratic 
programming methods to a "stationary point" of an MPEC is analyzed in and the exten- 

sion of interior point methods to MPECs is described in \21\ \'M\. For other related methods, see 
[71 13 HH USl HSl Uni , and the monographs . 

Unfortunately, solving the equivalent NLP ((J)) does not in itself guarantee global optimality, 
despite the practical success of NLP solvers. The reason is that the nonconvex nature of the 
complementarity constraint implies that NLP solvers may fail to find the global minimum, or even 
a feasible point. Nevertheless, NLP solvers have been shown to provide good solutions for many 
practical MPECs [HllSni) and this is the feature we wish to exploit here. In fact, for the numerical 
example reported in Section |SJ an NLP solver finds a solution, which we show through additional 
techniques is a global minimum. We note that the latter proof is demonstrated not by NLP but 
rather by exhibiting an upper bound for mvaR that coincides with a lower bound. 
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3.3 LP Lower Bounds 



Upper bounding alone is not enough to verify global optimality of a nonconvex problem. In this 
subsection, we develop some valid lower bounds for mvaR- As a first remark, we note that the 
simple LP relaxation of (jlj) is 



minimize m 

subject to X £ X 

Pi 



< n, - Ai > 



= l,...,/c (8) 



< Aj, m + Ti- x^y' > 

and ''^^^i ~ 

1=1 

which does not have a finite optimal solution because we can make m tend to — oo with each 
Tj — > oo. Therefore, we need to tighten this relaxation. The following lemma gives a preliminary 
lower bound for mvaR- 

Lemma 3.2 For any feasible tuple (m, x,r. A) to Q), an index i exists such that m > x'^y^ for at 
least one index i. Consequently, 

m > min min x'^y^ = m. 
l<j<k x(^X 

Proof. Let {m,x^T, A) be an arbitrary feasible tuple to (jlJ). We must have 

Tj = max(0, — m), = 1, . . . , fc. 
From the first complementarity constraint in Q), we obtain 

1-/3 

which, when used in the second complementarity constraint, yields 

= m A, + Ti - A, x'^yK (10) 

Since the sum of the Aj is equal to unity, we deduce 

k 



j=i 



(11) 



which yields 

k k 

m + max(0, x'^y^ — m) = Xj x'^y^ . 

i=i " ^ j=i 

If no index i exists such that x^y* < m, then m < x'^y^ for all j, and the above identity yields 



8 



which shows that m is a convex combination of the family {x y , ■ ■ ■ , x y }. This is a contradiction 



The last assertion of the lemma is obvious. 



□. 



In essence, the lower bounding procedure described below aims at removing the three nonlinear 
terms mA,, rAj, and XiX in @ and (|1U|) . which are the result of the complementarity constraints, 
while maintaining some form of these two equations. It turns out that the first two nonlinear terms 
can be completely removed through some suitable substitution, whereas the third one cannot. The 
relaxation of Q) then employs a single variable to substitute for AjX and to remove the identity 
= XiX when Aj is strictly between its lower and upper bounds. Note that the change of variables 
implies 



X 



E 

i=l 



Z . 



Furthermore, if x > in the set X, it follows that < < — for all i. More generally, 

if < a for all x G X, where a is a given nonnegative vector and the absolute sign is meant 
componentwise, then |z*| < — P))a for all i. 

From the identity we deduce that for any feasible tuple {m,x,T, A) to (0)), 



m > 



Vi, 



< 



Pi 



1-/3 



Ti < 



Pi 



1-/3 



m 



m < 



Vi, 



> {z' fy' 



Pi ^ Pi 

Ti > m 



1-/3 ' - 1-/3 

Assume for the moment that m > 0. This gives rise to the following LP relaxation of Q) (we 
assume that |x| < a for all x G X): 

minimize m 

k 

subject to X = z^ G X, 



m 



k 

■Y. 



j \T„j EL 



{z^Yy 



Ti 



< {z'fy 



1-/3 ^ 
m + Ti — x"^y* > 



Pi ^ Pi 
■ Ti < m 



1-/3 ' - 1-/3 



(12) 



TV > 



Pi 



yi = 1, 



X 



1-/3 ) 

We are also interested in investigating the behavior of this lower bound if we branch on a disjunction. 
It follows from Q that there are three possible branches for Aj. Each branch in turn gives rise to 
a particular implication: 

= Ai ^ [z' = and n = 0] 



A,; 



< A,: < 



Pi 



1-/3 

Pi 
1-/3 



Pi 



1-/3 



[Ti = 



X and Si =01 



and Si = 0]. 
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Based on the above implications, we define three LPs by adding the impHcations to the lower 
bounding LP (|12() . respectively. In what follows, io is a fixed but arbitrary index in {1, . . . ,k}. 

(LPj^-^^) This corresponds to the case where Aj^ = and m > and consists of the LP relaxation 
()12() with the following additional constraints: 

= and Tig = 0. (13) 



(LPj'jj^) This corresponds to the case where Ajp = pj(,/(l — /?) and m > and consists of the LP 
relaxation 1)12(1 with the following additional constraints: 

= and Si, = 0. (14) 

(LPj'jj j^) This corresponds to the case where Xi, G (O,pio/(1 — /3)) and m > and consists of the 
LP relaxation ()12|) with the following additional constraints: 

Tio = Sio = 0. (15) 

Let LPj*^'°''*, LP^'°|'*, and LP^J°?* denote the optimal objective values of the above three LPs, 
respectively. Consistent with a standard convention in optimization, we define the minimum ob- 
jective value of an infeasible LP to be oo. The next result summarizes the fundamental role of the 
above LPs for solving the VaR minimization problem (jlj). 

Proposition 3.3 For any index iq, the following five statements (a)-(e) are valid. 

(a) If {m, x,T, X) is feasible to (jlj) and m > 0, then with = AjX for all i, the tuple {m,x, z,t) 

is feasible to ((T^ . It also satisfies the additional constraints ((T^ if Ajg =0, (fTl)) if Ajg = 
PiJil - P), and (O if < A,„ < Ko/(l - (3). 

(b) If m-vaR > 0, then at least one of the three LPs obtained by adding to ((T^ the cuts (fT^. or 

(fTH) . or (|T^ . must be feasible and, hence, solvable; in this case, 



mvaR > min [ LP™, LP-f-, LP-^j . (16) 

(c) If muB ^ "T-VaR ^ and oo > LPj^j°^* > rn-uB) then for any optimal solution (x^^^, r^^^^ A^'^^) 

of (HI), we must have A°p* > 0, and thus, s^^^ = r^^^ + mvaR - (x^^^)"^?/^" = 0. 

(d) If muB > "iVaR > and oo > LP^'°''* > m\jB, then for any optimal solution (x^^^, r^'^^, A^'^^) 

of (HI), we must have Xj^^^ < Pio/{l - P), and thus, Tj^''^ = 0. 

(e) If muB > "iVaR > and oo > LPj^J°^* > m\jB, then for any optimal solution (x^^^, r^'^^, A^'^^) 

of (HI), we must have A^*^^ = or'A^^^^ = pij{l - 0). 

Proof. Part (a) does not require a proof. For part (b), we need only to prove the bound ()16j) . 
Let {x^^^,T^^^,Xy^^) be an arbitrary optimal solution of (HJ corresponding to mvaR- the tuple 
{m\aRTX^^^ , z^^^ ,T^^^), where z^aR.i ^ ^VaR^-VaR^ jg fg^gibig the one of the three LPs formed 
from (|12j) plus (fTH|) . or (fTH) . or (P3|) . Hence (|T?)|) follows readily. To prove (c), one need only note 
that if X^f^ = 0, then (mvaR, x^^^, z^^^, r^^^), where z^^^'' = A^^'^x^''^, is feasible to hence 
'TT-VaR ^ LP^j'°^*, which easily yields a contradiction. The proof of (d) and (e) is similar and not 
repeated. □ 
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We can similarly set up three other LPs to handle the case mvaR ^ 0. It suffices to reverse the 
inequality signs in 

o<(.) v-Y^^-^<Y^^^ 

and use instead 

0>(.-)V-^..>^™. (17) 

Letting LPj^j'"''*, LFj^'"^*, and LPj^j°^* denote the optimal objective values of the resulting LPs, 
respectively, we can obtain a result similar to Proposition 13.31 Combining these two results, we 
arrive at a desired lower bound for mvaR- 

Corollary 3.4 It holds that 



w-VaR ^ min < max min ( LPj'^-'°''*, LPj*!'"^', LPj'jj"^* ) , max min ( LPj-'"^', LPj'j'"^*, LP 



opt 
IIIJ 



□ 



The practical value of the cuts p3jl , (|14|) , and (|15jl , and their analogs with the reverse inequalities 
H17|) built in, lies in their ability to improve the lower bound obtained from ()12() making it easier 
to fathom nodes in the branch-and-cut framework that is described in Section |11 

3.4 Convex Hull Relaxations 

Alternative lower bounds can be derived by observing that the only difference between the simple 
LP © and the LPEC @ is the absence of the complementarity constraint. Thus, to tighten the 
former LP relaxation, we form a linear relaxation of the complementarity constraint. 



m 

i=l 



where we have used the fact that X] Aj = 1. Observe that the only nonlinear term in this expression 
is given by XiX^y^. Next we show how to construct the convex hull relaxation of this constraint. 

We introduce new linear variables 7^ = x^y^ and then replace the nonlinear terms Aj7j by Wi. 
Since Wi = Xiji is a simple bilinear expression, we can strengthen this LP relaxation by adding the 
convex hull of Wi = Xi^i. Let Lj and Ui be valid lower and upper bounds on 7j, respectively (these 
can be obtained by solving 2k LPs for instance); the convex hull of Wi = jiXi is then given by 

Wi > Li Xi 



Pi I rr \ Pi TT 

Wi < Ui Xi 

^ Pi , r \ Pi T 

Wi < ^ _ ^ 7i + -Lt At - ^ _ ^ Li, 



} ; (19) 
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see, for example |39j . This gives rise to the LP relaxation 



minimize 



m 



subject to X = G X 

i=l 

< n, 



and 



Pi 



A,; > 



< Xi, m + Ti- x'^y' > 



Vi 



l,...,k 



1 



Pi , TT ^ P 



(20) 



- 1-/3 
-Wi < f^i Aj 
Pi 



1-/3 

k 



m 



i=l 



7j + Ui Xi 



-fi + Li Xi 



Pi 



1-/3 



1-/3 



Vi 



1-/3 



Since this LP includes the convex hull relaxation of Wi = jiXi, it follows that the LP is bounded 
whenever the original LPEC is bounded. 

The two LP bounds (|12() and ()2Up are nondominating; the quality of the bounds differs from 
problem instance to problem instance. This is confirmed by the numerical example in Sectional 
where, in one case, ()12() yields a sharper lower bound, and in the other case, it is (|20() that yields 
a better bound. Next, we show how the bounds (|12|) and (|2flj) can be employed within a branch- 
and-cut framework to prove the optimality of a candidate solution of the LPEC (0]). 



4 Verifying Optimality by Branch- and- Cut 

We briefly outline our approach to prove the optimality of a given candidate solution to the MPEC 
(jlj). There are two main ideas: the first is to construct as small as possible a branch-and-bound 
tree corresponding to a given candidate solution, and the second is to exploit the logical implica- 
tions from the complementarity constraint to strengthen the LP relaxation as in Proposition 13.31 
Section 13 shows how the approach works for a numerical example. 

The use of branch-and-bound to solve MPECs is not new. It has been used in |3| to solve some 
bilevel convex programs. However, the scheme proposed here employs the special bounds derived 
in the preceding section that are tailored to the minimum VaR problem and that are used to define 
cuts that restrict the feasible region of the problem. 

In general, the LPEC is initially solved with the complementarity constraint relaxed. If this 
problem yields a solution that is complementary, then it is also optimal. Otherwise there exists a 
complementarity that is violated and we can branch on this complementarity. Branching introduces 
two (or three in our case) child problems where the complementarity is broken. The procedure 
continues to solve relaxations and branch until an LPEC feasible solution is found, a problem is 
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infeasible, or its solution is dominated by an upper bound. This process is best envisioned as a tree 
search where nodes correspond to LP relaxations and edges correspond to branches. 

Unfortunately, searching the entire branch-and-bound tree is likely to be inefficient. Instead, 
we will exploit the branch-and-cut methodology to construct the smallest tree that can be used to 
establish optimality of a given feasible solution. Specifically, let (m^,, x*, A*, r*) be a feasible point of 
the LPEC Q) whose optimality we wish to prove. Note that is an upper bound on the optimal 
value of the LPEC. We then perform several rounds of bound tightening to fix complementary 
expressions by solving LP relaxations. For instance, if we postulate that A* = — then we 
solve the two remaining LP relaxations in the disjunction. If they produce bounds that are larger 
than the given upper bound m*, then we can fix A* = Pi/{1 — f3). Similar conclusions are possible 
for the other bounds and variables. This generates one hopes a short branch-and-bound tree. The 
numerical example presented next illustrates the idea. 

5 Numerical Example 

The numerical example has the following data: n = 3, /c = 27, /3 = 0.9, pi = 1/27 for all i, 

!n n ^ 

1=1 i=l ) 

where r = (—1/3,2/3,-1) and / = 1/10. The vectors are generated as follows. We generate 
three vectors 



- - 




' 5 





-6 " 






7 





-5 






. 2 





-5 . 



and then we set 

y{ = d\il), yi = d\i2), vi = d'\i3), 
where j = 6{il - 1) + 3{i2 - 1) + i3 for il,i2, i3 = 1, 2, 3. 



5.1 Finding an Upper Bound 

We first solve the CVaR LP and obtain the solution: CVaR = 5.0644, mcvaR = 4.8613, 
^CVaR ^ (0.1097,0.6161,0.2742), n > 0, t^, = for all i > 2, s, = for i = 1,2, 10, and > for 
all other i. The value mcvaR is then verified to be the least element of Aii3{x'^^^^). Based on the 
pair {mcYnR, x'^^'^^), we solve the LP © by setting 

U 5° = {1,2}, 70 U (/30\'5°) = {l,...,27}\a0, 

al U6l = {1, 2, 10}, 7^ U iPl \6l) = {!,..., 27} \ 0° . 

The optimal solution for this LP is as follows: mi = 4.2652; ti and T2 are both positive, and the 
remaining Tj are zero; Sj = for i = 1,2, 3, 10, and the other Si are all positive. This solution yields 
Ai = A2 at their common upper bound, which is 0.37037, implying that A3 > and Aio > satisfy 
A3 + Aio = 1 - 2 * 0.37037 = .26926. 

The pair (m-cvaR, s:*""^^^) also belongs to several other pieces of the feasible region of @. For 
example, one such piece corresponds to the index set partitions: 

U 50 = {1, 10}, 7° U (/30 \ = {1, . . . , 27} \ aO, 

al Udl = {1, 2, 10}, 7^ U iPl \ = {1, . . . , 27} \ ««; 
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nevertheless, solving the associated LPs © on these other pieces does not yield a lower objective 
value than 4.2652. The same upper bound muB = 4.2652 is also obtained by solving the single 
equivalent NLP 0. 



5.2 Branching to Verify Global Optimality 

Our next task is to determine whether the value muB = 4.2652 is globally optimal. First, we verify 
that m-vaR > by solving the LP 

minimize m 



subject to X = G X 

k 

J \T„j El 



m + Ti — x^y^ > 



> {z')'^y 



Pi ^ Pi 
■ Tj > m 



1-p - 1-13 



Ti > 0, < < 



Pi 



yi = 1, 



.k. 



1-13 ) 

This LP is infeasible, and we can therefore conclude that mvaR > 0. 



' 3 ■ ■ ■ ^27 




Figure 1: Branch-and-bound tree for the numerical example 



Figure ^ shows the branch-and-bound tree that we construct for this example. Each node 
corresponds to an LP relaxation, with additional constraints included according to (fTT?|) . (|T1|) . or 
H15|) . The root node shows the value of the LP relaxation ()12() (all values are rounded to two digits) . 
The variable names on the left indicate the branching variable. For each Aj there are three branches 
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(which are ordered from left to write as Aj = 0, Aj G (0,pj/(l — /?)), Aj =,pj/(l — /?)). For each Tj 
there are two branches (from left to right Tj = 0, and Tj > 0). 

The lower bounds alone do not allow us to conclude optimality of the candidate solution. Hence, 
we start the construction of the branch-and-bound tree by proving that Ai and A2 must be at their 
upper bounds at an optimal solution. For this purpose, we solve two LPs by adding the cuts H13() 
and (|15)) to p2j) . These LPs have an optimal value of 5.3, which is larger than mus; we can 
therefore consider those nodes as fathomed. This is illustrated in the tree in Figure ^ by the bold 
horizontal lines under the node. Hence, we can fix Ai at its upper bound. Next, this process is 
repeated for A2, and we also find that A2 can be fixed at its upper bound. 

Next, we consider proving that T3 = ... = T27 = 0. First note that Tj can be either zero or 
positive. If Ti > 0, then Aj = Pi/{1 — (3) is at its upper bound and Tj = x^y* — m in (jlj. However, 
since 1 — Ai — A2 < Pi/(1 — /?), it follows that the LP corresponding to Tj > must be inconsistent 
for alH = 3, . . . , 27. This is represented in Figure^by the grey nodes. In practice, the preprocessor 
in AMPL detects that these LPs are inconsistent, and no solves are necessary. Hence, we conclude 
that r3 = ... = T27 = 0. Solving the LP relaxation H12|) with these Ti fixed at zero and also 
si = S2 = (since Ai and A2 are at their upper bounds), we obtain a lower bound of 4.2652, which 
means that our candidate solution is globally optimal. 

All in all, we solved only six LPs to prove the global optimality of the candidate solution. The 
empty nodes are never solved, while the grey nodes can be eliminated by the preprocessor. 

For this example, we have compared the two lower bounds (|12() and H20() with /3 = 0.8 and 
P = 0.9. With f3 = 0.8, the LP relaxation gives a lower bound of m = 0.61, which is poorer than the 
convex hull relaxation, which gives m = 1.24. However, with /5 = 0.9, the LP relaxation H12|) gives 
the tighter bound with m = 3.48, while (|20jl gives only m = 2.45. Hence, we use the LP relaxation 
H12|) in the above report. (For this example, both lower bounds would actually generate identical 
trees except for the value at the root.) We have also used the same branch-and-cut procedure 
to verify global optimality in the problem with /3 = 0.8. Apart from the fact that the details 
are similar, with /? = 0.8, the vector x*-'^'^^ obtained by solving the CVaR minimization problem 
produced a VaR that is already globally optimal, as verified by the branch-and-cut procedure. In 
other words, the upper bounding refinement is not needed in the case where /3 = 0.8; for this reason, 
we omit the details. □ 



6 Approximation by Smoothing 

In two pioneering papers jUEj) Mangasarian and his then-Ph.D. student Chen developed a class of 
smoothing methods for solving complementarity problems. The basis of their methods is a family 
of smooth functions that approximate the plus function A summary of these functions can be 
found in 8, Subsection 11.8.2]. In what follows, we show how a smoothing approach can be applied 
to the VaR minimization problem. 

Let ps be any nonnegative-valued, twice continuously differ entiable, strictly convex function 
defined on the real line such that |/0£(t)| < 1 and p"{t) > for all t, and for some constant c > 0, 

\t+- peit) \ < ce, Vt G 3f?, (21) 

for all e > sufficiently small. The latter approximating property has several consequences; among 
these, we have 

lim Ps{t) = 00 and lim Peit) = 0. (22) 
Two examples of such a smoothing function are 

p,,i(t) ^ elog(l+e*/^) and p.,2(0 ^ y^l±^^±l_ 
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We leave it to the reader to verify that these functions satisfy the assumed properties. 

In general, given a smoothing function with the cited properties, consider the e-approximate 
CVaR and VaR minimization problems: 



minimize CVaR/3^e(a;) 
subject to X ^ X 



and 



minimize VaR^_g(x) 
subject to X ^ X 



where 



CVaR;3,e(x) 



mm 

mg3t 



m + ——z ^ Pi pe {x^y' 



1-/3 



and VaR^^£(x) is the unique minimizer in the definition of CVaR/3^e(2;). It follows from the assumed 
properties of pe that the minimand in CVaR^_e(x) is a coercive function of m, for fixed x, that is. 



lim 

m— *±oo 



m + 



i-;3 



E 



ViP. 



mj 



oo. 



(Use the second limit in 1)22(1 to show the case m ^ oo and the first limit and the nonexpansiveness 
of Pe, which in turn is implied by the condition < 1 for all t, to show the other case 

m — oo.) Therefore, CVaR^^£(x) is a well-defined, finite scalar. Moreover, by the strict convexity 
of ps, it follows that VaR/3^e(x) is uniquely defined. The latter is a significant difference from the 
original CVaR^(3;) where the minimizing set A^^(x) is often not a singleton. Another important 
consequence with using the smooth function is that VaR^ ^(x) can be characterized as the unique 
scalar m that satisfies the smooth equation: 

k 

1 - /? = ^ Pi Peix^y' - m). 

i=l 

This implies, by the implicit-function theorem, that the VaR^^£(x) is a continuously differentiable 
function of x with gradient given by 



VVaR^,,(x) 



J^p,p;(xV-VaRs,,(x))y^ 

i=l 

k 

J]pip;(xV-VaR^,,(x)) 

i=l 



The upshot of these properties is that VaR^^£(x) has much nicer analytic properties than VaR^(x); 
furthermore, the e-approximate VaR minimization problem is a smooth, albeit still nonconvex, 
linearly constrained nonlinear program in the sole variable x. As such, there are a host of efficient 
algorithms that one can use for computing the minimum value (to be precise, stationary values) of 
the e-approximate value-at-risk. 

An important question that arises is what happens to the convergence of the e-approximation 
problems as e | 0. Although such a question has been partially studied in a general context (see, 
6-g-, HZI)) we give a self-contained treatment to such a convergence issue for our special problem. 
For this purpose, we establish a preliminary boundedness lemma. 

Lemma 6.1 Let {Eu} be a sequence of sufficiently small positive scalars, and let {x'^} be an 
arbitrary sequence of vectors in X, both of which are necessarily bounded. The sequence {niu}, 
where mjy = VaR^^£^(x'^) for every v, is bounded. Moreover, if the pair (moQ,x°°) is the limit of 
a convergent subsequence {{m,^,x'^) : v G k} corresponding to a sequence {e^} of positive scalars 
tending to zero, then moo is an element of Aij3{x°°). 
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Proof. We have, for any m € ?R. and any v, 

k , k 



which imphes, by the uniform approximation property ()21j) . 

1 ^ 1 ^ 2 c £ 

Since the right-hand side is bounded, the boundedness of the sequence {my] fohows readily. More- 
over, the second assertion of the lemma also follows easily from the last inequality. □ 

We introduce the notation for our next result, which addresses the main convergence issue of the 
e-smoothing procedure. Specifically, let {e^} be an arbitrary sequence of positive scalars converging 
to zero. For each e > 0, let be a (globally) optimal solution of the smooth optimization problem: 

minimize VaRfl p ix) 

^'^ (23) 
subject to X € X, 

which is clearly equivalent to 



mmimize m 
subject to X £ X 



and I — P = ^^Pi p^{x^y^ — m). 



i=l 



Let nip = VaRflffx'^l 



Proposition 6.2 Suppose that the VaR minimization problem has a minimizer x^^^ such that 
Mp{x^^^) is the singleton {mvaR}- It holds that 

lim me = min VaR^(x). (24) 

Consequently, for any sequence of positive scalars {e^} converging to zero, every accumulation 
point of {x^"} is a minimizer of VaR^(x) on X. 

Proof. Let {e^} be an arbitrary sequence of positive scalars tending to zero. We have, for every i/, 

m,^ < VaR^,,,(xV-i^). 

By Lemma f6.1l every accumulation point of the right-hand side is an element of 7W^(x^'^^), which by 
assumption is the singleton {mvaR}- Consequently, the right-hand side converges to mvaR as | 0. 
If (moo,a;°°) is the limit of a convergent subsequence {{me^^x'^") : u £ k}, then moo £ ■M./3{x°°), 
and, from the above inequality, 

moo < "iVaR = VaR/3(x^''^); 

this shows that x°° is a minimizer of VaR^(x) on X and also establishes the desired limit H24() . □ 

ProDosition l6.2l is theoretically very desirable; its practical drawback is that there is no guarantee 
that a globally optimal solution to (|23|) can be computed. We have implemented the two smoothing 



17 



functions p^^i and p^^2 using e = 10~ for the example of the previous section. To solve the smoothed 
problem, we used five state-of-the-art NLP solvers: filter, knitro 3.0, loqo 6.06, minos 5.5, and snopt 
6.6-1, which are all available on the NEOS server [HI I26j. The MPEC solver required 5 iterations 
to produce an upper bound for the example on hand, which turns out to be globally optimal. In 
contrast, the NLP solvers fail for p^^i because the exponentials cannot be evaluated or blow up 
during the computation. The situation is slightly better for the square root formulation. Filter 
produces an optimal solution m = 4.265827 (which is slightly higher than the minimum VaR of 
4.2652); knitro produces a local optimum m = 4.74277. All other solvers fail to produce a feasible 
point (minos and snopt), while loqo fails because it reached its iteration limit. 

7 Conclusion 

In this paper, we have investigated the minimization problem of the VaR as a nonconvex LPEC 
and developed bounding schemes that can be used to verify the global optimality of a candidate 
feasible solution. We have also established the convergence of a smoothing approach to compute 
an approximate VaR. Whereas the VaR minimization problem is special (and yet important in its 
own right), we maintain that the bounding schemes can be extended to more general LPECs, and 
possibly even to other "convex" MPECs, namely, MPECs whose only nonconvexity is the comple- 
mentarity constraint. Indeed, the extension of the upper bounding scheme is fairly straightforward; 
it is the lower bounding scheme that is very much problem dependent. Nevertheless, we believe 
that for special classes of MPECs, tight lower bounds can be obtained, which can then be used in 
a branch-and-cut scheme either for verifying the global optimality of a candidate solution obtained 
from a local MPEC solver or for computing a globally optimal solution to the problem directly. 

A lesson we have learned from the computational experiments in this paper is that while the NLP 
solvers are generally very robust, one still requires a proof such as the one given in Subsection 15.21 
to ascertain the quality of the solutions they produce. For MPECs, we believe that the time is 
now ripe for combining existing local methods with some global branch-and-cut schemes in order 
to obtain solutions with proven global optimality. 

Acknowledgment. Professor Stanislav Uryasev has kindly alerted us to his paper with Larsen 
and Mausser JHl iu which CVaR-based algorithms are proposed for solving the VaR-minimization 
problem. 
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